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Abstract 

Constraint programming uses enumeration and search tree pruning to 
solve combinatorial optimization problems. In order to speed up this so- 
lution process, we investigate the use of semidefinite relaxations within 
constraint programming. In principle, we use the solution of a semidef- 
inite relaxation to guide the traversal of the search tree, using a limited 
discrepancy search strategy. Furthermore, a semidefinite relaxation pro- 
duces a bound for the solution value, which is used to prune parts of 
the search tree. Experimental results on stable set and maximum clique 
problem instances show that constraint programming can indeed greatly 
benefit from semidefinite relaxations. 

1 Introduction 

Constraint programming models for combinatorial optimization problems con- 
sist of variables on finite domains, constraints on those variables and an objec- 
tive function to be optimized. In general, constraint programming solvers use 
domain value enumeration to solve combinatorial optimization problems. By 
propagation of the constraints (i.e. removal of inconsistent values), large parts 
of the resulting search tree may be pruned. Because combinatorial optimiza- 
tion problems are NP-hard in general, constraint propagation is essential to 
make constraint programming solvers practically applicable. Another essential 
part concerns the enumeration scheme, that defines and traverses a search tree. 
Variable and value ordering heuristics as well as tree traversal heuristics greatly 
influence the performance of the resulting constraint programming solver. 

In this work we investigate the possibility of using semidefinite relaxations in 
constraint programming. This investigation involves the extraction of semidef- 
inite relaxations from a constraint programming model, and the actual use of 
the relaxation inside the solution scheme. We propose to use the solution of a 
semidefinite relaxation to define search tree ordering and traversal heuristics. 
Effectively, this means that our enumeration scheme starts at the suggestion 



made by the semidefinite relaxation, and gradually scans a wider area around 
this solution. Moreover, we use the solution value of the semidefinite relaxation 
as a bound for the objective function, which results in stronger pruning. By ap- 
plying a semidefinite relaxation in this way, we hope to speed up the constraint 
programming solver significantly. These ideas were motivated by a previous 
work PP, in which a linear relaxation was proved to be helpful in constraint 
programming. 

We implemented our method and provide experimental results on the sta- 
ble set problem and the maximum clique problem, two classical combinatorial 
optimization problems. We compare our method with a standard constraint 
programming solver, and with specialized solvers for maximum clique prob- 
lems. As computational results will show, our method obtains far better results 
than a standard constraint programming solver. However, on maximum clique 
problems, the specialized solvers appear to be much faster than our method. 

This paper is an extended and revised version of In the current ver- 
sion, a more general view on the proposed method is presented. Namely, in |2] 
the method was proposed for stable set problems only, while in this paper we 
propose the method to be applied to any constraint programming problem, al- 
though not all problems will be equally suitable. Furthermore, in P] the method 
uses a subproblem generation framework on which limited discrepancy search 
is applied. In the current work it has been replaced by limited discrepancy 
search on single values, which is more concise while preserving the behaviour 
of the algorithm. Finally, more experimental results are presented, including 
problem characterizations and instances of the DIMACS benchmark set for the 
maximum clique problem. 

The outline of the paper is as follows. The next section gives a motivation 
for the approach proposed in this work. Then, in Section |3| some preliminaries 
on constraint and semidefinite programming are given. A description of our 
solution framework is given in Section^ In Section Owe introduce the stable 
set problem and the maximum clique problem, integer optimization formulations 
and a semidefinite relaxation. Sectional presents the computational results. We 
conclude in Section [71 with a summary and future directions. 

2 Motivation 

NP-hard combinatorial optimization problems are often solved with the use of 
a polynomially solvable relaxation. Often (continuous) linear relaxations are 
chosen for this purpose. Also within constraint programming, linear relaxations 
are widely used, see [3] for an overview. Let us first motivate why in this 
paper a semidefinite relaxation is used rather than a linear relaxation. For some 
problems, for instance for the stable set problem, standard linear relaxations are 
not very tight and not informative. One way to overcome this problem is to 
identify and add linear constraints that strengthen the relaxation. But it may 
be time-consuming to identify such constraints, and by enlarging the model the 
solution process may slow down. 
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On the other hand, several papers on approximation theory following 0] 
have shown the tightness of semidefinite relaxations. However, being tighter, 
semidefinite programs are more time-consuming to solve than linear programs in 
practice. Hence one has to trade strength for computation time. For some (large 
scale) applications, semidefinite relaxations are well-suited to be used within a 
branch and bound framework (see for instance Moreover, our intention is 
not to solve a relaxation at every node of the search tree. Instead, we propose 
to solve only once a relaxation, before entering the search tree. Therefore, we 
are willing to make the trade-off in favour of the semidefinite relaxation. 

Finally, investigating the possibility of using semidefinite relaxations in con- 
straint programming is worthwile in itself. To our knowledge the cross-ferti- 
lization of semidefinite programming and constraint programming has not yet 
been investigated. Hence, this paper should be seen as a first step toward the 
cooperation of constraint programming and semidefinite programming. 

3 Preliminaries 

3.1 Constraint Programming 

In this section we briefiy introduce the basic concepts of constraint program- 
ming that are used in this paper. A thorough explanation of the principles of 
constraint programming can be found in .6 . 

A constraint programming model consists of a set of variables, corresponding 
variable domains, and a set of constraints restricting those variables. In case 
of optimization problems, also an objective function is added. In this work 
the variable domains are assumed to be finite. A constraint c is defined as a 
subset of the Cartesian product of the domains of the variables that are in c. 
Constraints may be of any form (linear, nonlinear, logical, symbolic, etcetera), 
provided that the constraint programming solver contains an algorithm to check 
its satisfiability, or even to identify globally inconsistent domain values. 

Basically, a constraint programming solver tries to find a solution of the 
model by enumerating all possible variable-value assignments such that the 
constraints are all satisfied. Because there are exponentially many possible 
assignments, constraint propagation is needed to prune large parts of the corre- 
sponding search tree. Constraint propagation tries to remove inconsistent values 
from variable domains before the variables are actually instantiated. Hence, one 
doesn't need to generate the whole search tree, but only a part of it, while still 
preserving a complete (exact) solution scheme. The general solution scheme is 
an iterative process in which branching decisions are made, and the effects are 
propagated subsequently. 

Variable and value ordering heuristics, which define the search tree, greatly 
influence the constraint propagation, and with that the performance of the 
solver. If no suitable variable and value ordering heuristics are available, con- 
straint programming solvers often use a lexicographic variable and value order- 
ing, and depth-first search to traverse the tree. However, when good heuristics 
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are available, they should be applied. 

When 'perfect' value and variable ordering heuristics are followed, it will 
lead us directly to the optimal solution (possibly unproven). Although perfect 
heuristics are often not available, some heuristics come pretty close. In such 
cases, one should try to deviate from the first heuristic solution as little as 
possible. This is done by traversing the search tree using a limited discrepancy 
search strategy (LDS) instead of depth-first search. 

LDS is organized in waves of increasing discrepancy from the first solution 
provided by the heuristic. The first wave (discrepancy 0) exactly follows the 
heuristic. The next waves (discrepancy i, with z > 0), explore all the solutions 
that can be reached when i derivations from the heuristic are made. Typically, 
LDS is applied until a maximum discrepancy has been reached, say 3 or 4. 
Although being incomplete (inexact), the resulting strategy often finds good 
solutions very fast, provided that the heuristic is informative. Of course LDS can 
also be applied until all possible discrepancies have been considered, resulting 
in a complete strategy. 

3.2 Semidefinite Programming 

In this section we briefly introduce semidefinite programming. A large number 
of references to papers concerning semidefinite programming are on the web 
pages [S] and [S]. A general introduction on semidefinite programming applied 
to combinatorial optimization is given in (10) and |llj . 

Semidefinite programming makes use of positive semidefinite matrices of 
variables. A matrix X € R"^" is said to be positive semidefinite (denoted by 
X y 0) when Xy > for all vectors y G R". Semidefinite programs have the 
form 

max tiiWX) 
s.t. triAjX) < bj (j = 1, . . . , to) (1) 

X yo. 

Here tr{X) denotes the trace of X, which is the sum of its diagonal elements, 
i.e. tr{X) = T,7=i^vi- The matrix X, the cost matrix W <E M"''" and the 
constraint matrices Aj e M"^" are supposed to be symmetric. The m reals bj 
and the m matrices Aj define to constraints. 

We can view semidefinite programming as an extension of linear program- 
ming. Namely, when the matrices W and Aj [j — 1, . . . ,to) are all supposed 
to be diagonal matrices^ , the resulting semidefinite program is equal to a linear 
program, where the matrix X is replaced by a non-negative vector of variables 
X € M". In particular, then a semidefinite programming constraint tv{AjX) < bj 
corresponds to a linear programming constraint ajx < bj, where aj represents 
the diagonal of Aj . 

Theoretically, semidefinite programs have been proved to be polynomially 
solvable to any fixed precision using the so-called ellipsoid method (see for in- 

diagonal matrix is a matrix with nonnegative values on its diagonal entries only. 
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stance jOj)- In practice, nowadays fast 'interior point' methods are being used 
for this purpose (see |13 | for an overview). 

Semidefinite programs may serve as a continuous relaxation for (integer) 
combinatorial optimization problems. Unfortunately, it is not a trivial task to 
obtain a computationally efficient semidefinite program that provides a tight 
solution for a given problem. However, for a number of combinatorial opti- 
mization problems such semidefinite relaxations do exist, for instance the stable 
set problem, the maximum cut problem, quadratic programming problems, the 
maximum satisfiability problem, and many others (see | 11| for an overview). 

4 Solution Framework 

The skeleton of our solution framework is formed by the constraint programming 
enumeration scheme, or search tree, as explained in Section 13.11 Within this 
skeleton, we want to use the solution of a semidefinite relaxation to define the 
variable and value ordering heuristics. In this section we first show how to 
extract a semidefinite relaxation from a constraint programming model. Then 
we give a description of the usage of the relaxation within the enumeration 
scheme. 

4.1 Building a Semidefinite Relaxation 

We start from a constraint programming model consisting of a set of variables 
{vi, . . . , Vn}, corresponding finite domains {-Di, . . . , Dn}, a set of constraints 
and an objective function. From this model we need to extract a semidefinite 
relaxation. In general, a relaxation is obtained by removing or replacing one 
or more constraints such that all solutions are preserved. If it is possible to 
identify a subset of constraints for which a semidefinite relaxation is known, 
this relaxation can be used inside our framework. Otherwise, we need to build 
up a relaxation from scratch. This can be done in the following way. 

If all domains Di, . . . , Z?„ are binary, a semidefinite relaxation can be ex- 
tracted using a method proposed by jl4j. which is explained below. In general, 
however, the domains are non-binary. In that case, we transform the variables 
Vi and the domains Di into corresponding binary variables Xij for i e {1, . . . , n} 
and j £ Di. 

Vi = j ^ Xij =1, 

Vi ^ j =0. ^ ' 

We will then use the binary variables Xij to construct a semidefinite relaxation. 
Of course, the transformation has consequences for the constraints also, which 
will be discussed below. 

The method to transform a model with binary variables into a semidefinite 
relaxation, presented in ^1], is the following. Let d e {0,1}^ be a vector of 
binary variables, where JV is a positive integer. Construct the (A^ -I- 1) x (A^ -I- 1) 
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variable matrix X as 



X = 




Then X can be constrained to satisfy 



X,,=Xo^ Vi G {l,...,iV} 



X ^ 



(3) 
(4) 



where the rows and columns of X are indexed from to N . Condition 
expresses the fact that = di, which is equivalent to di € {0, 1}. Note however 
that the latter constraint is relaxed by requiring X to be positive semidefinite. 

The matrix X contains the variables to model our semidefinite relaxation. 
Obviously, the diagonal entries (as well as the first row and column) of this 
matrix represent the binary variables from which we started. Using these vari- 
ables, we need to rewrite (a part of) the original constraints into the form of 
program |^ in order to build the semidefinite relaxation. 

In case the binary variables are obtained from transformation not all 
constraints may be trivially transformed accordingly. Especially because the 
original constraints may be of any form. The same holds for the objective 
function. On the other hand, as we are constructing a relaxation, we may choose 
among the set of constraints an appropriate subset to include in the relaxation. 
Moreover, the constraints itself are allowed to be relaxed. Although there is no 
'recipe' to transform any given original constraint into the form of program 
one may use results from the literature ^Tj. For instance, for linear constraints 
on binary variables a straightforward translation is given in Section [3. 21 

4.2 Applying the Semidefinite Relaxation 

At this point, we have either identified a subset of constraints for which a 
semidefinite relaxation exists, or built up our own relaxation. Now we show 
how to apply the solution to the semidefinite relaxation inside the constraint 
programming framework, also depicted in Figure Q In general, the solution 
to the semidefinite relaxation yields fractional values for its variable matrix. 
For example, the diagonal variables Xa of the above matrix will be assigned 
to a value between and 1. These fractional values serve as an indication for 
the original constraint programming variables. Consider for example again the 
above matrix X, and suppose it is obtained from non-binary original variables, 
by transformation |(5J. Assume that variable Xu corresponds to the binary 
variable Xjk (for some integer j and fc), which corresponds to Vj — fc, where Vj 
is a constraint programming variable and k e Dj. If variable X^ is close to 
1, then also Xj}^ is supposed to be close to 1, which corresponds to assigning 
Vj = k. 

Hence, our variable and value ordering heuristics for the constraint program- 
ming variables are based upon the fractional solution values of the correspond- 
ing variables in the semidefinite relaxation. Our variable ordering heuristic is 
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Figure 1: Communication between constraint programming (CP) and semidef- 
inite programming (SDP). 



to select first the constraint programming variable for which the corresponding 
fractional solution is closest to the corresponding integer solution. Our value 
ordering heuristic is to select first the corresponding suggested value. For exam- 
ple, consider again the above matrix X, obtained from non-binary variables by 
transformation We select first the variable Vj for which Xu, representing 
the binary variable Xjk, is closest to 1, for some k e Dj and corresponding 
integer i. Then we assign value k to variable Vj. We have also implemented a 
randomized variant of the above variable ordering heuristic. In the randomized 
case, the selected variable is accepted with a probability proportional to the 
corresponding fractional value. 

We expect the semidefinite relaxation to provide promising values. There- 
fore the resulting search tree will be traversed using limited discrepancy search, 
defined in Section |0] A last remark concerns the solution value of the semidef- 
inite relaxation, which is used as a bound on the objective function in the 
constraint programming model. If this bound is tight, which is the case in our 
experiments, it leads to more propagation and a smaller search space. 

5 The Stable Set Problem and Maximum Clique 
Problem 

This section describes the stable set problem and the maximum clique problem 
(see |15II16| for a survey), on which we have tested our algorithm. First we give 
their definitions, and the equivalence of the two problems. Then we will focus 
on the stable set problem, and formulate it as an integer optimization problem. 
From this, a semidefinite relaxation is inferred. 
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5.1 Definitions 



Consider an undirected weighted graph G — {V, E), where y = {1, . . . , n} is the 
set of vertices and E a subset of edges &V,i^ j} of G, with \E\ = m. 

To each vertex i & V a weight G R is assigned (without loss of generahty, we 
can assume all weights to be nonnegative) . 

A stable set is a set 5 C 1/ such that no two vertices in S are joined by 
an edge in E. The stable set problem is the problem of finding a stable set of 
maximum total weight in G. This value is called the stable set number of G and 
is denoted by q;(G)^. In the unweighted case (when all weights are equal to 1), 
this problem amounts to the maximum cardinality stable set problem, which 
has been shown to be already NP-hard |17|. 

A clique is a set G C 1/ such that every two vertices in G are joined by an 
edge in E. The maximum clique problem is the problem of finding a clique of 
maximum total weight in G. This value is called the clique number of G and is 
denoted by tj(G)^. 

The complement graph of G is G = (V,i?), with the same set of vertices 
V = but with edge_set E = e V,{i,j) i E,i ^ j). It 

is well known that a{G) = uj{G). Hence, a maximum clique problem can be 
translated into a stable set problem on the complement graph. We will do 
exactly this in our implementation, and focus on the stable set problem, for 
which good semidefinite relaxations exist. 

5.2 Integer Optimization Formulation 

Let us first consider an integer linear programming formulation for the stable 
set problem. We introduce binary variables to indicate whether or not a vertex 
belongs to the stable set S. So, for n vertices, we have n integer variables Xi 
indexed by i g V^, with initial domains {0, 1}. In this way, = 1 if vertex i is 
in S*, and Xi = Q otherwise. We can now state the objective function, being the 
sum of the weights of vertices that are in 5, as X]r=i ^i^i- Finally, we define the 
constraints that forbid two adjacent vertices to be both inside S as Xi -\- Xj < 1, 
for all edges € E. Hence the integer linear programming model becomes: 

a(G) = max X)"=i '^i^i 

s.t. Xi +Xj <1 V(i,j) e E (5) 
x^ e {0, 1} Vi e V. 

Another way of describing the same solution set is presented by the following 
integer quadratic program 

a(G) = max X]r=i '^i^i 

s.t. x^x■j^O y{iJ)eE (6) 

xf =Xi v« e V. 

^In the literature a{G) usually denotes the unweighted stable set number. The weighted 
stable set number is then denoted as a^{G). In this work, it is not necessary to make this 
distinction. 

"^iiJw (G) is defined similar to (G) and also not distinguished in this paper. 
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Note that here the constraint Xi G {0,1} is replaced by — Xi, similar to 
condition Q in Section ^ This quadratic formulation will be used below to 
infer a semidefinite relaxation of the stable set problem. 

In fact, both model © and model ® can be used as a constraint program- 
ming model. We have chosen the first model, since the quadratic constraints 
take more time to propagate than the linear constraints, while having the same 
pruning power. To infer the semidefinite relaxation, however, we will use the 
equivalent model ©. 

5.3 Semidefinite Programming Relaxation 

The integer quadratic program ^ gives rise to a well-known semidefinite re- 
laxation introduced by Lovasz |18 (see 12" for a comprehensive treatment). 
The value of the objective function of this relaxation has been named the theta 
number of a graph G, indicated by i9(G). For its derivation into a form similar 
to program we will follow the same idea as in Section0]for the general case. 

As our constraint programming model uses binary variables already, we can 
immediately define the {n+ 1) x (n + l) matrix variable X of our relaxation as 




where the binary vector x again represents the stable set, as in 

SectionO First 

we impose the constraints 

XhO (7) 
Xu = Xo^ Vze{l,...,n} (8) 

as described in Section^ Next we translate the edge constraints XiXj — from 
program © into Xij — 0, because Xij represents XiXj. In order to translate 
the objective function, we first define the (rt -I- 1) x {n + 1) weight matrix W as 

W^^=W^ Vi G {1, . . . , n}, 

W^J =0 Vi e {0,...,n},j £ {0,...,n},i^ j. 

Then the objective function translates into tr(WX). The semidefinite relaxation 
thus becomes 

i9(G) = max tr(WX) 

s.t. Xu = Xoi yi eV , , 

X -^0. 

Note that program © can easily be rewritten into the general form of pro- 
gram (^. Namely, Xa = Xoi is equal to tr{AiX) — where the (rt-|- 1) x (n+l) 
matrix Ai consists of all zeroes, except for {Ai)ii — 1, {Ai)io — — ^ and 
{Ai)oi = —\, which makes the corresponding right-hand side {hi entry) equal to 
(similarly for the edge constraints). 
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The theta number also arises from other formulations, different from the 
above, see |12| . In our implementation we have used the formulation that has 
been shown to be computationally most efficient among those alternatives jl9|. 
Let us introduce that particular formulation (called -d^ in 12,). Again, let 
a; G {0, 1}" be a vector of binary variables representing a stable set. Define 
the n X n matrix X — where = . ^=Xi. Furthermore, let the 

yZ^ j = i ^j^j 

n X n cost matrix U be defined as Uij — ^Jwjw] for i,j £ V. Observe that in 
these definitions we exploit the fact that > for all i £ V. The following 
semidefinite program 

z9(G) = max tr{UX) 
s.t. tr(X) = l 

x,, = o y{i,j)eE ^ ' 

X hO 

has been shown to also give the theta number of G, see When (|10|l is solved 
to optimality, the scaled diagonal element •d{G)Xii (a fractional value between 
and 1) serves as an indication for the value of Xi (i € V^) in a maximum stable 
set (see for instance ^Hl)- Again, it is not difficult to rewrite program Hl()|l into 
the general form of program 

Program H1U|I uses matrices of dimension n and m + 1 constraints, while 
program ((SJ uses matrices of dimension n + 1 and m + n constraints. This gives 
an indication why program H10|l is computationally more efficient. 



6 Computational Results 

All our experiments are performed on a Sun Enterprise 450 (4 X UltraSPARC- 
II 400MHz) with maximum 2048 Mb memory size, on which our algorithms 
only use one processor of 400MHz at a time. As constraint programming solver 
we use the ILOG Solver library, version 5.1 [201 • As semidefinite programming 
solver, we use CSDP version 4.1 gT], with the optimized ATLAS 3.4.1 
and LAPACK 3.0 libraries for matrix computations. The reason for our 
choices is that both solvers are among the fastest in their field, and because 
ILOG Solver is written in C++, and CSDP is written in C, they can be hooked 
together relatively easy. 

We distinguish two algorithms to perform our experiments. The first al- 
gorithm is a sole constraint programming solver, which uses a standard enu- 
meration strategy. This means we use a lexicographic variable ordering, and 
we select domain value 1 before value 0. The resulting search tree is traversed 
using a depth-first search strategy. After each branching decision, its effect is 
directly propagated through the constraints. As constraint programming model 
we have used model as was argued in Section 1^?^ 

The second algorithm is the one proposed in Section 0] It first solves the 
semidefinite program (|10|l . and then calls the constraint programming solver. 
In this case, we use the randomized variable ordering heuristic, defined by the 
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Figure 2: Performance of the constraint programming solver on random in- 
stances with n vertices. 




Figure 3: Performance of the semidefinite programming solver on random in- 
stances with n vertices. 



solution of the semidefinite relaxation. The resulting search tree is traversed 
using a limited discrepancy search strategy. In fact, in order to improve our 
starting solution, wc repeat the search for the first solution n times, (where n 
is the number of variables), and the best solution found is the heuristic solution 
to be followed by the limited discrepancy search strategy. 

6.1 Characterization of Problem Instances 

Wc will first identify general characteristics of the constraint programming solver 
and the semidefinite programming solver applied to stable set problems. It 
appears that both solvers are highly dependent on the edge density of the graph, 
i-^- 1 („T_„) for a graph with n vertices and m edges. We therefore generated 
random graphs on 30, 40, 50 and 60 vertices, with density ranging from 0.01 up 
to 0.95. Our aim is to identify the hardness of the instances for both solvers, 
parametrized by the density. Based upon this information, we can identify the 
kind of problems our algorithm is suitable for. 
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We have plotted the performance of both solvers in Figure El and Figure 01 
Here the constraint programming solver solves the problems to optimality, while 
the semidefinite programming solver only solves the semidefinite relaxation. For 
the constraint programming solver, we depict both the number of backtracks 
and the time needed to prove optimality. For the semidefinite programming 
solver we only plotted the time needed to solve the relaxation. Namely, this 
solver does not use a tree search, but a so-called primal-dual interior point 
algorithm. Note that we use a log-scale for time and number of backtracks in 
these pictures. 

From these figures, we can conclude that the constraint programming solver 
has the most difficulties with instances up to density around 0.2. Here we see 
the effect of constraint propagation. As the number of constraints increases, 
the search tree can be heavily pruned. On the other hand, our semidefinite 
relaxation suffers from every edge that is added. As the density increases, the 
semidefinite program increases accordingly, as well as its computation time. For- 
tunately, for the instances up to 0.2, the computation time for the semidefinite 
relaxation is very small. Consequently, our algorithm is expected to behave best 
for graphs that have edge density up to around 0.2. For graphs with a higher 
density, the constraint programming solver is expected to use less time than the 
semidefinite programming solver, which makes the application of our method 
unnecessary. 

6.2 Random Weighted and Unweighted Graphs 

Our first experiments are performed on random weighted and unweighted graphs. 
We generated graphs with 50, 75, 100, 125 and 150 vertices and edge density 
from 0.05, 010 and 0.15, corresponding to the interesting problem area. The 
results are presented in Table ^ Unweighted graphs on n vertices and edge 
density r are named 'gndr'. Weighted graphs are similarly named 'wgndr'. 

The first five columns of the table are dedicated to the instance, reporting 
its name, the number of vertices n and edges m, the edge density and the 
(best known) value of a stable set, a. The next three columns (CP) present 
the performance of the constraint programming solver, reporting the best found 
estimate of a, the total time and the total number of backtracks needed to prove 
optimality. The last five columns (SDP-f CP) present the performance of our 
method, where also a column has been added for the discrepancy of the best 
found value (best discr), and a column for the time needed by the semidefinite 
programming solver (sdp time). 

Table shows that our approach always finds a better (or equally good) 
estimate for a than the standard constraint programming approach. This be- 
comes more obvious for larger n. However, there are two (out of 30) instances in 
which our method needs substantially more time to achieve this result (g75d015 
and wg75d010). A final observation concerns the discrepancy of the best found 
solutions. Our method appears to find those (often optimal) solutions at rather 
low discrepancies. 



12 



Table 1: Computational results on random graphs, with n vertices and m edges. 
All times are in seconds. The time limit is set to 1000 seconds. 
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> 24 


limit 




> 24 


4 


9.81 


limit 




gl25d005 


125 


393 





05 




> 49 


> 44 


limit 




> 49 


1 


4.92 


limit 




gl25d010 


125 


791 





10 




> 33 


> 30 


limit 




> 33 


6 


12.58 


limit 




gl25d015 


125 


1160 





15 




> 27 


> 24 


limit 




> 27 


1 


29.29 






gl50d005 


150 


545 





05 




> 52 


> 44 


limit 




> 52 


3 


10.09 


limit 




gl50d010 


150 


1111 





10 




> 38 


> 32 


limit 




> 38 


4 


27.48 


limit 




gl50d015 


150 


1566 





14 




> 29 


> 26 


limit 




> 29 


8 


57.86 


limit 




wg50d005 


50 


70 





06 




740 


740 


4.41 


30528 


740 





0.29 


0.3 





wgSOdOlO 


50 


126 





10 




636 


636 


3.12 


19608 


636 





0.41 


0.41 





wgSOdOlS 


50 


171 





14 




568 


568 


4.09 


25533 


568 





0.59 


4.93 


13042 


wg75d005 


75 


128 





05 




1761 


1761 


744.29 


4036453 


1761 





1.05 


1.07 





wg75d010 


75 


284 





10 




1198 


1198 


325.92 


1764478 


1198 


13 


1.9 


924.2 


1974913 


wg75d015 


75 


409 





15 




972 


972 


40.31 


208146 


972 





3.62 


51.08 


87490 


wglOOdOOS 


100 


233 





05 




2302 


> 2176 


limit 




2302 





2.59 


2.62 





wglOOdOlO 


100 


488 





10 


> 


1778 


> 1778 


limit 




> 1778 


2 


6.4 


limit 




wglOOdOlS 


100 


750 





15 


> 


1412 


> 1412 


limit 




> 1412 


2 


15.21 


limit 




wgl25d005 


125 


372 





05 


> 


3779 


> 3390 


limit 




> 3779 


3 


5.39 


limit 




wgl25d010 


125 


767 





10 


> 


2796 


> 2175 


limit 




> 2796 





18.5 


limit 




wgl25d015 


125 


1144 





15 


> 


1991 


> 1899 


limit 




> 1991 


4 


38.24 


limit 




wgl50d005 


150 


588 





05 


> 


4381 


> 3759 


limit 




> 4381 


3 


13.57 


limit 




wgl50d010 


150 


1167 





10 


> 


3265 


> 2533 


limit 




> 3265 


9 


40.68 


limit 




wgl50d015 


150 


1630 





15 


> 


2828 


> 2518 


limit 




> 2828 


11 


82.34 


limit 





6.3 Graphs Arising from Coding Theory 

The next experiments are performed on structured (unweighted) graphs arising 
from coding theory, obtained from We have used those instances that 

were solvable in reasonable time by the semidefinite programming solver (here 
reasonable means within 1000 seconds). For these instances, the value of a 
happened to be known already. 

The results are reported in Table [3 which follows the same format as Ta- 
ble^ It shows the same behaviour as the results on random graphs. Namely, our 
method always finds better solutions than the standard constraint programming 
solver, in less time or within the time limit. This is not surprising, because the 
edge density of these instances are exactly in the region in which our method is 
supposed to behave best (with the exception of ldc.64 and lzc.128), as analyzed 
m Section inUl A gain, our method finds the best solutions at a low discrepancy. 
Note that the instance let. 64 shows the strength of the semidefinite relaxation 
with respect to standard constraint programming. The difference in computa- 
tion time to prove optimality is huge. 
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Table 2: Computational results on graphs arising from coding theory, with n 
vertices and m edges. All times are in seconds. The time limit is set to 1000 
seconds. 















CP 








SDP + 


CP 










edge 








back- 




beat 


sdp 


total 


back- 














time 


tracks 




discr 


time 


time 


tracks 


ldc.64 


64 


543 


0.27 


10 


10 


11.44 


79519 


10 





5.08 


5.09 





ldc.128 


128 


1471 


0.18 


16 


> 16 


limit 




16 





49.95 


49.98 





ldc.256 


256 


3839 


0.12 


30 


> 26 


limit 




30 





882.21 


882.33 





let. 64 


64 


264 


0.13 


18 


18 


273.06 


2312832 


IS 





1.07 


1.08 





let. 128 


128 


672 


0.08 


28 


> 28 


limit 




> 28 





11.22 


limit 




let. 256 


256 


1664 


0.05 


50 


> 46 






> 50 





107.58 


limit 




ltc.64 


64 


192 


0.10 


20 


> 20 






20 





0.78 


0.79 





ltc.128 


128 


512 


0.06 


38 


> 37 






38 





8.14 


8.18 





ltc.256 


256 


1312 


0.04 


63 


> 58 






> 63 


4 


72.75 


limit 




ltc.512 


512 


3264 


0.02 


110 


> 100 


limit 




> 110 


2 


719.56 


limit 




lzc.128 


128 


2240 


0.28 


18 


> 18 


limit 




> 18 


4 


129.86 


limit 





Table 3: Computational results on graphs from the DIMACS benchmark set 
for maximum clique problems, with n vertices and m edges. All times are in 
seconds. The time limit is set to 1000 seconds. 















CP 








SDP + 


CP 










edge 






to 


tal 


back- 




best 




total 










density 






ti 




tracks 




discr 


time 


time 




hamming6-2 


64 


192 


0.095 


32 


32 


20 


22 


140172 


32 





0.68 


0.69 





hamming6-4 


64 


1312 


0.651 


4 


4 





28 


804 


4 





27.29 


28.10 


706 


hamming8-2 


256 


1024 


0.031 


128 


> 128 


lir 


nit 




128 





45.16 


45.55 





johiison8-2-4 


28 


168 


0.444 


4 


4 





05 


255 


4 





0.35 


0.35 





johiison8-4-4 


70 


560 


0.232 


14 


14 


15 


05 


100156 


14 





4.82 


4.83 





johiisonl6-2-4 


120 


1680 


0.235 


8 


> 8 


lir 


nit 




8 





43.29 


43.32 





MANN_a9 


45 


72 


0.072 


16 


16 


162 


81 


1738506 


16 


1 


0.17 


82.46 


411104 


MANN_a27 


378 


702 


0.010 


126 


> 103 


lir 


nit 




> 125 


3 


70.29 


limit 




MANN_a45 


1035 


1980 


0.004 


345 


> 156 


lir 


nit 




> 338 


1 


1047.06 


limit 




san200_0.9_l 


200 


1990 


0.100 


70 


> 45 


lir 


nit 




70 





170.01 


170.19 





san200_0.9_2 


200 


1990 


0.100 


60 


> 36 


lir 


nit 




60 





169.35 


169.51 





san200_0.9_3 


200 


1990 


0.100 


44 


> 26 


lir 


nit 




44 





157.90 


157.99 





sanr200_0.9 


200 


2037 


0.102 


42 


> 34 


lir 


nit 




> 41 


4 


131.57 


limit 





6.4 Graphs from the DIMACS Benchmarks Set 

Our final experiments are performed on a subset of the DIMACS benchmark set 
for the maximum clique problem j25| . Although our method is not intended to 
be competitive with the best heuristics and exact methods for maximum clique 
problems, it is still interesting to see its performance on this standard benchmark 
set. As pointed out in Section |31 we have transformed these maximum clique 
problems to stable set problems on the complement graph. 

The results are reported in Table |3| which again follows the same format as 
Table Q The choice for this particular subset of instances is made by the solv- 
ability of an instance by a semidefinite programming solver in reasonable time 
(again, reasonable means 1000 seconds). For all instances with edge density 
smaller than 0.24, our method outperforms the standard constraint program- 
ming approach. For higher densities however, the opposite holds. This is exactly 
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Table 4: A comparison of different methods on graphs from the DIMACS bench- 
mark set for maximum clique problems, with n vertices and m edges. All times 
are in seconds. 



insta 






Ost 


eri 


gard 




Regin 






CP + SDP 




edge 








total 






back- 






back- 




density 








time 




time 


tracks 




time 


tracks 


hamming6-2 


0.095 


32 


32 




0.01 


32 


0.00 


17 


32 


0.69 





hamming6-4 


0.651 


4 


4 




0.01 


4 


0.00 


42 


4 


28.10 


706 


hamming8-2 


0.031 


128 


128 




0.04 


128 


0.00 


65 


128 


45.55 





johnson8-2-4 


0.444 


4 


16 




0.01 


4 


0.00 


14 


4 


0.35 





johnsonS-4-4 


0.232 


14 


14 




0.01 


14 


0.00 


140 


14 


4.83 





johnsonl6-2-4 


0.235 


8 


8 




0.27 


8 


11.40 


250505 


8 


43.32 





MANN_a9 


0.073 


16 


16 




0.01 


16 


0.00 


50 


16 


82.46 


411104 


MANN_a27 


0.010 


126 




> 


10000 


126 


55.44 


1258768 


> 125 


> 1000 




MANN_a45 


0.004 


345 




> 


10000 


> 345 


> 43200 




> 338 


> 1000 




san200_0.9_l 


0.100 


70 


70 




0.27 


70 


3.12 


1040 


70 


170.19 





san200_0.9_2 


0.100 


60 


60 




4.28 


60 


7.86 


6638 


60 


169.51 





san200_0.9_3 


0.100 


44 




> 


10000 


44 


548.10 


758545 


44 


157.99 





sanr200_0.9 


0.102 


42 




> 


10000 


42 


450.24 


541496 


> 41 


> 1000 





what could be expected from the analysis of Section IHjI A special treatment 
has been given to instance MANN_a45. We stopped the semidefinite program- 
ming solver at the time limit of 1000 seconds, and used its intermediate feasible 
solution as if it were the optimal fractional solution. We then proceeded our al- 
gorithm for a couple of seconds more, to search for a solution up to discrepancy 
1. 

In Table0]we compare our method with two methods that are specialized for 
maximum clique problems. The first method was presented by Ostergard jSH) . 
and follows a branch-and-bound approach. The second method is a constraint 
programming approach, using a special constraint for the maximum clique prob- 
lem, with a corresponding propagation algorithm. This idea was introduced by 
Fahle and extended and improved by Regin ,28j| . Since all methods are per- 
formed on different machines, we need to identify a time ratio between them. 
A machine comparison from SPEC'* shows that our times are comparable with 
the times of Ostergard. We have multiplied the times of Regin with 3, following 
the time comparison made in |28j . In general, our method is outperformed by 
the other two methods, although there is one instance on which our method 
performs best (san200_0.9_3). 

7 Conclusion and Future Work 

We have presented a method to use semidefinite relaxations within constraint 
programming. The fractional solution values of the relaxation serve as an in- 
dication for the corresponding constraint programming variables. Moreover, 
the solution value of the relaxation is used as a bound for the corresponding 
constraint programming objective function. 

http : //www . spec . org/| 
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We have implemented our method to find the maximum stable set in a graph. 
Experiments are performed on random weighted and unweighted graphs, struc- 
tured graphs from coding theory, and on a subset of the DIMACS benchmarks 
set for maximum clique problems. Computational results show that constraint 
programming can greatly benefit from semidefinite programming. Indeed, the 
solution to the semidefinite relaxations turn out to be very informative. Com- 
pared to a standard constraint programming approach, our method obtains far 
better results. Specialized algorithms for the maximum clique problem however, 
generally outperform our method. 

The current work has investigated the possibility of exploiting semidefinite 
relaxations in constraint programming. Possible future investigations include 
the comparison of our method with methods that use linear relaxations, for 
instance branch-and-cut algorithms. Moreover, one may investigate the effects 
of strengthening the relaxation by adding redundant constraints. For instance, 
for the stable set problem so-called clique-constraints (among others) can be 
added to both the semidefinite and the linear relaxation. Finally, the proof of 
optimality may be accelerated similar to a method presented in PP, by adding 
so-called discrepancy constraints to the semidefinite or the linear relaxation, 
and recompute the solution to the relaxation. 
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